MFSR: Light Field Images Spatial Super Resolution Model Integrated with Multiple Features

نویسندگان

چکیده

Light Field (LF) cameras can capture angular and spatial information simultaneously, making them suitable for a wide range of applications such as refocusing, disparity estimation, virtual reality. However, the limited resolution LF images hinders their applicability. In order to address this issue, we propose an end-to-end learning-based light field super-resolution (LFSR) model called MFSR, which integrates multiple features, including spatial, angular, epipolar plane (EPI), global features. These features are extracted separately from image then fused together obtain comprehensive feature using Feature Extract Block (FE Block) iteratively. Gradient loss is added into function ensure that MFSR has good performance with rich texture. Experimental results on synthetic real-world datasets demonstrate proposed method outperforms other state-of-the-art methods, peak signal-to-noise ratio (PSNR) improvement 0.208 dB 0.274 average 2× 4× tasks, structural similarity (SSIM) both improvements 0.01 average.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Super-resolution of Defocus Blurred Images

Super-resolution is a process that combines information from some low-resolution images in order to produce an image with higher resolution. In most of the previous related work, the blurriness that is associated with low resolution images is assumed to be due to the integral effect of the acquisition device’s image sensor. However, in practice there are other sources of blurriness as well, inc...

متن کامل

Spatial and frequency-based super-resolution of ultrasound images

Modern ultrasound systems can output video images containing more spatial and temporal information than still images. Super-resolution techniques can exploit additional information but face two challenges: image registration and complex motion. In addition, information from multiple available frequencies is unexploited. Herein, we utilised these information sources to create better ultrasound i...

متن کامل

Spatial and Angular Variational Super-Resolution of 4D Light Fields

We present a variational framework to generate super-resolved novel views from 4D light field data sampled at low resolution, for example by a plenoptic camera. In contrast to previous work, we formulate the problem of view synthesis as a continuous inverse problem, which allows us to correctly take into account foreshortening effects caused by scene geometry transformations. High-accuracy dept...

متن کامل

Light Field Super-Resolution Via Graph-Based Regularization

Light field cameras can capture the 3D information in a scene with a single shot. This special feature makes light field cameras very appealing for a variety of applications: from the popular post-capture refocus, to depth estimation and imagebased rendering. However, light field cameras suffer by design from strong limitations in their spatial resolution, which should therefore be augmented by...

متن کامل

Super-resolution from Multiple Images Having Arbitrary Mutual Motion

1. INTRODUCTION Video sequences usually contain a large overlap between successive frames, and regions in the scene are sampled in several images. This multiple sampling can sometime be used to achieve images with a higher spatial resolution. The process of reconstructing a high resolution image from several images covering the same region in the world is called Super Resolution. Additional tas...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Electronics

سال: 2023

ISSN: ['2079-9292']

DOI: https://doi.org/10.3390/electronics12061480